Testing multiple outcomes in repeated measures designs.
نویسندگان
چکیده
This study investigates procedures for controlling the familywise error rate (FWR) when testing hypotheses about multiple, correlated outcome variables in repeated measures (RM) designs. A content analysis of RM research articles published in 4 psychology journals revealed that 3 quarters of studies tested hypotheses about 2 or more outcome variables. Several procedures originally proposed for testing multiple outcomes in 2-group designs are extended to 2-group RM designs. The investigated procedures include 2 modified Bonferroni procedures that adjust the level of significance, alpha, for the effective number of outcomes and a permutation step-down (PSD) procedure. The FWR, any-variable power, and all-variable power are investigated in a Monte Carlo study. One modified Bonferroni procedure frequently resulted in inflated FWRs, whereas the PSD procedure controlled the FWR. The PSD procedure could be substantially more powerful than the conventional Bonferroni procedure, which does not account for dependencies among the outcome variables. However, the difference in power between the PSD procedure, which does account for these dependencies, and Hochberg's step-up procedure, which does not, were negligible. A numeric example illustrates implementation of these multiple-testing procedures.
منابع مشابه
Equivalence and noninferiority testing in regression models and repeated-measures designs.
Equivalence and noninferiority designs are useful when the superiority of one intervention over another is neither expected nor required. Equivalence trials test whether a difference between groups falls within a prespecified equivalence region, whereas noninferiority trials test whether a preferred intervention is either better or at least not worse than the comparator, with worse being define...
متن کاملHE Plots for Repeated Measures Designs
Hypothesis error (HE) plots, introduced in Friendly (2007), provide graphical methods to visualize hypothesis tests in multivariate linear models, by displaying hypothesis and error covariation as ellipsoids and providing visual representations of effect size and significance. These methods are implemented in the heplots for R (Fox, Friendly, and Monette 2009a) and SAS (Friendly 2006), and appl...
متن کاملSelecting a sample size for studies with repeated measures
Many researchers favor repeated measures designs because they allow the detection of within-person change over time and typically have higher statistical power than cross-sectional designs. However, the plethora of inputs needed for repeated measures designs can make sample size selection, a critical step in designing a successful study, difficult. Using a dental pain study as a driving example...
متن کاملAligned Rank Tests As Robust Alternatives For Testing Interactions In Multiple Group Repeated Measures Designs With Heterogeneous Covariances
متن کامل
Rank - based comparisons of treatments with a control for repeated measures designs
In this paper the problem of comparing several treatments with a control in a one-way repeated measures design is considered. Multiple testing procedures based on rank transformation data are proposed for determining which treatments are more effective than the control. The results of a Monte Carlo level and power study are presented.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Psychological methods
دوره 15 3 شماره
صفحات -
تاریخ انتشار 2010